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Geometric symmetry in the quadratic Fisher 
discriminant operating on image pixels 

Robert S. Caprari 



Abstract — This article examines the design of Quadratic Fisher Dis- 
criminants (QFDs) that operate directly on image pixels, when image 
ensembles are taken to comprise all rotated and reflected versions of 
distinct sample images. A procedure based on group theory is devised 
to identify and discard QFD coefficients made redundant by symmetry, 
for arbitrary sampling lattices. This procedure introduces the concept 
of a degeneracy matrix. Tensor representations are established for the 
square lattice point group (8-fold symmetry) and hexagonal lattice point 
group (12-fold symmetry). The analysis is largely applicable to the 
symmetrisation of any quadratic filter, and generalises to higher order 
polynomial (Volterra) filters. Experiments on square lattice sampled 
synthetic aperture radar (SAR) imagery verify that symmetrisation of 
QFDs can improve their generalisation and discrimination ability. 

Index Terms — pattern recognition; statistical target detection; image 
processing; lattice symmetry; group theory; dihedral groups. 



I. INTRODUCTION 

In image target detection, one often desires to detect all geometric 
symmetry transformed versions of targets, for two reasons. One rea- 
son is that for any given target pattern, all symmetry transformed ver- 
sions also are valid target patterns, to at least a good approximation. 
The other reason is that so few separate target patterns are available 
for detector training, relative to the number of detector coefficients, 
that the detector has the capacity to learn the peculiarities of each 
individual pattern, rather than being forced to learn the universal 
properties of the target pattern class. Symmetry transformation of 
available target patterns creates additional patterns, which even if not 
valid target patterns, at least share many of the universal properties 
of genuine target patterns. Training the detector on both actual and 
transformed target patterns discourages overlearning of individual 
pattern peculiarities, and encourages learning of universal pattern 
properties. 

There are four distinct classes of geometric point transformations 1 : 
rotation; reflection; shear; and dilation. Rotation is a sense-preserving 
rigid-body transformation. Reflection is a sense-reversing rigid-body 
transformation. Shear is an angle-modifying, area-preserving transfor- 
mation. Dilation is an angle-preserving, area-modifying transforma- 
tion. Usually only rotation operations are considered in image target 
detection [l]-[4]. Reflection operations also are valid where targets 
have approximate mirror symmetry, or where the second reason in the 
previous paragraph is the motivating factor for considering symmetry. 
Dilation and shear have the fundamental theoretical drawback that no 
matter how symmetrical the detector support, there is always a flux of 
image content into or out of the support under these transformations, 
so that the detector support is not transformed onto itself. Dilations 
have the additional theoretical drawback for sampled (discrete) im- 
ages that all strict dilations map non-lattice points onto lattice points, 
and all strict contractions map lattice points onto non-lattice points; 
once again, the discrete-space detector support is not mapped onto 
itself. These properties of dilation and shear preclude their inclusion 
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in group theoretical methods of accounting for geometric symmetry 2 
in pattern recognition, as developed here and elsewhere [5]-[8]. 
Group theoretical considerations make rotation and reflection the 
only allowable geometric symmetries in this analysis. Even then, 
the detector support requires at least the same rotation and mirror 
symmetry, and orientation 3 , as the sampling lattice, for the discrete 
space support to map onto itself, as it must. If one treats images as 
being spatially continuous and detector supports infinitely large, then 
dilation and shear are permissible symmetry operations [9]. 

This article presents the group theory based geometric symmetry 
analysis of the Quadratic Fisher Discriminant (QFD) operating on im- 
age pixels. Encapsulated in the analysis is a method of symmetrising 
any quadratic detector, not just the QFD. The mathematical formalism 
generalises in a straightforward manner to polynomial detectors of 
arbitrary degree (Volterra filters). Symmetrisation of the QFD, or 
indeed any polynomial filter, is a means of reducing the number 
of detector coefficients by identifying and discarding redundant 
coefficients, without introducing approximations. In contrast, most 
approaches to reducing polynomial filter complexity approximate the 
desired filter by a simpler version [10]. 

A synopsis of this article is as follows. Section [n] introduces 
notation and establishes the square lattice symmetry group. Section liTTI 
derives the consequences for the QFD of sampling lattice symmetry. 
Section ITVI solves for the symmetrised QFD, using a procedure that 
is suitable for arbitrary quadratic filters, and that easily extends to 
higher degree polynomial filters. Section|V|establishes the hexagonal 
lattice symmetry group, and notes the detail changes in the preceding 
analysis if images are sampled on an hexagonal lattice instead of a 
square lattice. Section lvTl experimentallv demonstrates the symmetri- 
sation of a QFD for target detection in synthetic aperture radar (SAR) 
images sampled on a square lattice. 

II. SQUARE LATTICE SYMMETRY 

As shown in Figure □ the square lattice is generated by two equal 
length basis vectors subtending angle n/2. To exploit the symmetry 
of the sampling lattice, the detector support must be a polygon with 
the same symmetry as the lattice, except for translational symmetry. 
Conventionally, a square lattice is taken to use a square detector 
support of dimension n x n pixels, with total pixel count 

N = n\ (1) 

and with lattice basis vectors as perpendicular bisectors of its sides. 
Although not considered here, another (unusual) possibility is a 
square detector support centred on a lattice point and oriented so that 
the lattice basis vectors point at its vertices (i.e. a diamond shape). 

The set of symmetry operations that rigidly transform a lattice onto 
itself while leaving one lattice point fixed, form the point group of 
the lattice 4 . The fixed lattice point is the centre of symmetry. Point 
symmetries are restricted to rotations and reflections, since dilations 
and shears are prohibited for the reasons given in Section Q For 
a square lattice, the point group symmetry operations with centre 
displaced by one half lattice spacing horizontally and vertically from 

2 An example of the problem is that a dilation followed by its reverse 
contraction is not an identity transformation, because the original dilation 
ejected the periphery of the support, and the following contraction leaves a 
void in the same periphery, even though the interior of the support has been 
perfectly restored. 

3 A polygon and lattice of the same symmetry have the same orientation if 
their mirror lines coincide. 

4 The space group of a lattice comprises point symmetries plus translational 
symmetries. 
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Fig. 1. (Refer to Section|I]J A section of square lattice. Nonequivalent points 
marked X have identical symmetry. Detector supports of odd linear dimension 
centre on lattice points. Detector supports of even linear dimension centre on 
interstices. 

a lattice point, also map the square lattice onto itself, albeit without 
leaving any lattice point fixed (Figure 0. If the detector support has 
odd linear dimension (odd n) then it is centred on a lattice point, 
whereas if the detector support has even linear dimension (even n) 
then it is centred on an interstitial site. Although the two centres are 
not equivalent 5 , the square lattice has identical symmetry about both 
centres, and that symmetry is the point symmetry. 
A symmetry group T having s elements Ti, that is, 

T={Tx,...,T s } , (2) 

represents symmetry of order s (i.e. s-fold symmetry). Square lattice 
point symmetry is of order 

s — 8 (square lattice) . (3) 

Table |l] lists the 8 elements of the square lattice point group — being 
the dihedral group D4 6 — in the first column. The second column of 
Table describes the geometric operations corresponding to the point 
symmetries. Symmetries Ti to T 3 satisfy the four mandatory group 
properties: closure; presence of identity element; presence of all 
inverse elements; and associativity. The point group is non-Abelian, 
because in general symmetry operations do not commute (e.g. for the 
square lattice point group T 5 T 6 = T 4 / T 2 = T 6 T 5 ). 

Subgroups of T represent image ensembles with intermediate ge- 
ometric symmetry. For square lattice sampling: {Ti, T2, T3, T4} rep- 
resents a 4-fold rotation axis; {Ti, T 3 , T 5 , T 7 } and {Ti, T 3 , T 6 , T 8 } 
represent 4-fold rectangular symmetry; {Ti,Ts} represents a 2-fold 
rotation axis; {Ti,T 5 }, {Ti,T 6 }, {Ti,TV} and {Ti,T 8 } represent 
2-fold reflection symmetry (one mirror line); and {Ti} represents the 
complete absence of geometric symmetry. In the context of airborne 
surveillance, imaging in the nadir direction has the full symmetry 

5 Nonequivalent points are separated by a nonintegral combination of lattice 
vectors. 

6 Dihedral group D„ is the group of symmetry transformations of an n- 
sided regular polygon, being an n-fold rotation axis and n mirror lines. 



of group T, but side-looking SAR only has a mirror line along the 
range direction (y-axis), corresponding to subgroup {Ti,TV}. 

Introduce the 2-component index (2-index) {ij} to convert the two 
indices of detector pixels (row i and column j) into a single index, 

{ij}=i+{j-l)n : ije[l,n], {ij}e[l,N] , (4) 

thereby allowing pixels in the support to be column-ordered into the 
dimension N column vector a;' 1 ' with components a; ({i?}), where 
the (1) superscript signifies that a^ 1 ' is inherently a rank 1 tensor 
(i.e. vector). It is possible to construct QFD theory using 2-indices 
alone, at the expense of using rank 4 tensors. Alternatively, combining 
pairs of 2-indices ({ij} and {kl}) into 4-component indices ({ij, kl}) 
according to the prescription 

{ij,kl} = {ij} + ({kl}-l)N : 

{ij},{kl}e[l,N], {ij, kl}&[l,N 2 ] , (5) 

allows rank 4 tensors to be expressed as higher dimension rank 2 
tensors (i.e. square matrices), as will be seen forthwith. As a reminder 
that 4-indices are properly a pair of 2-indices, the notation {ij, kl} 
retains a comma between the first and second 2-indices. Pairwise 
products of pixels in the support are collected into the dimension 
N 2 column vector a;' 2 ' with components 

x^({ij,kl})=x w ({ij})x w ({kl}) , (6) 

where the (2) superscript signifies that is inherently a rank 2 
tensor 7 . 

Symmetry operation T m linearly transforms unprimed vectors into 
primed vectors as follows: 

x li)l = ri 2l) . (7) 

Tm , with components tm ({ij}; {i'j'}). is the rank 2 tensor 
representation of symmetry operation T m , Tm\ with components 
tm({ij, kl}; {i'j', k'l'Y), is the rank 4 tensor representation of 
symmetry operation T m . Use of 4-index notation allows T$ to be 
expressed in matrix form, but this is merely a notational convenience. 
Lattice point symmetries rearrange image pixels without altering pixel 
values (i.e. they are permutation operations on the pixel values), 
implying invariance of the Euclidean norm 8 



which ensures that all transformation matrices are orthogonal, that 
is," 

T^- 1 =T^ T ,m = l,...,s. (9) 

have determinants 1 or — l 10 . For a square lattice, Ti (2l) has 
eigenvalue 1, Tg ' and Xg*g have eigenvalues 1 and — 1, and T 2 
and Tj 2 ^ have eigenvalues 1, i, —1 and —i. Expanding Q in terms 
of tensor components, and substituting {SJ, connects components of 
the two representations by 

€\{ij, kl}; {i'j', k'l'}) = t%\{ij}; {i'j'}) t£> ({kl}; {k'l 1 }) . 

(10) 

7 x( 2 ) is the outer product of with itself. 

8 This length property establishes that tensors are defined in a Euclidean 
vector space, so they are cartesian tensors with no distinction between 
covariant and contravariant indices. 

9 The transpose of a rank 4 tensor with four 1-component indices is defined 
as the swapping of the first and second index pairs, with the index ordering 
in individual pairs not changing (i.e. t(i,j,k,l) becomes t(k,l,i,j)). 

10 It is not the case that all rotations have determinant 1 and all reflections 
have determinant — 1, because the matrices transform pixel values and not 
pixel coordinates (the latter being the common usage for transformation 
matrices). 
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Symmetry: 

T m 


Description of symmetry 
operation 


Factorisation 


Rank 2 tensor representation: 

"m VrJJ ) r J J / 


Ti 


Identity or unit operation. 




S(i,i'). 
°\3i3 ) 


T 2 


Anticlockwise rotation by 

1 !A him 

1/4 turn. 


T 2 


5(i,n -j' + 1). 

°\Jt 1 ) 


T 3 


Rotation by 1/2 turn, being 
inversion through centre. 


T 2 
1 2 


6(i,n- V + 1). 

Xfn ry-i at t 1 \ 

"\3i n — 3 + JJ 


T 4 


Clockwise rotation by 1/4 
turn. 


qn 3 
1 2 


S(i,j')- 

Xf A nn ii' _l_ "1 'l 

I J , 71 — t ~t~ J- J 


T 5 


Reflection in the x-axis. 


T 5 


8(i,n - i' + 1). 
"(3,3 1 


T 6 


Reflection in line 1/8 turn 
anticlockwise from x-axis. 


T 2 T 5 


6(i,n-j' + 1). 


T 7 


Reflection in the j/-axis. 


T 2 2 T 5 


iU. n " / + 1) 


T 8 


Reflection in line 1/8 turn 
clockwise from rr-axis. 


T 2 3 T 5 





TABLE I 

(Refer to SectionITTI Square lattice point group symmetry operations and their rank 2 tensor representation; the rank 4 tensor 
representation is derived from the rank 2 tensor representation according to itol ■ the detector support is square with sides of 
length n-pixels. orientation of the lattice is such that a basis vector aligns with the x-axis, as in figure^ 



Equation J10I implies that the rank 4 tensor components have 
permutation symmetry 

t^({ij,kl}-{i'j',k'l'})=t^({kl,ij}-{k'l',i'j'}) . (11) 

The rank 2 tensor representation of the square lattice point group is 
listed in the fourth column of Table|J the rank 4 tensor representation 
is computed from the rank 2 tensor representation according to J10L 

(2i) 

Each Tm matrix has a single one entry in every row and column. 
Computing the rank 2 tensor representation is efficiently done as 



follows. Derive matrices T 2 and T^' by inspection. Elements T2 
and T5 generate group T, as indicated in the third column of Table 

so the remaining elements of the rank 2 representation of T are 

(2) (2) 1 1 

computed by repeated multiplication of matrices T 2 and T* 5 

III. Symmetry invariants 

The underlying postulate of this analysis is that training ensemble 
statistics (clutter and target separately) are invariant with respect to all 
point symmetry transformations about the centre of detector support. 
Such statistical symmetry arises if every image in the actual ensemble 
contributes to a notional ensemble all symmetry transformations 
of itself (with equal weighting), and the notional ensemble is a 
more complete portrayal of the totality of images than the actual 
ensemble. There is no requirement for images in the ensembles to be 
individually invariant with respect to any symmetry transformations. 

The quadratic detector response is given by the scalar product 



(2) 



y(x) = f x , 



(12) 



where detector coefficients / and pixel terms x partition into rank 1 
and rank 2 tensors as 



(13) 







' x^ ' 




, X = 


x^ 



11^(2) 



representing the identity operation, is immediately set to the identity 



matrix, without being explicitly generated as T, 



(2)2 



Pixel terms have mean 



9 = 



9 W ' 



= {x) 



(14) 



and covariance 



C = 



c (2) £.(1+2) 
£(2+1) c (4) 



= ((x-{x))(x-{x)) T ) 



(15) 



C (i+j) = ( (x « _ (a.(0))( x tf) _ <a^>» T ) 



where (as usual) superscripts of the form (i) indicate that the quantity 
is inherently a rank i tensor. 

Ensemble statistics are invariant with respect to all symmetry 
transformations if and only if 

g (i) = T C2i) ffW and c a +j) = r c2<) C (i+ f) T m t ( 

m — 1, . . . , s . (16) 

Using the fact that any group element multiplying separately all group 
elements (including itself) yields all the group elements in a different 
order, one may verify that 



r<ii+j) - 1 \^ T (2i) r (i+j) T (2j)T 
C^ — — / 1 m C^ ±m 

S 

m — 1 



(17) 



i+i) 



satisfy invariance properties I16i for arbitrary and C' 
Furthermore, and C^ + ^ have the correct form to be ensemble 
statistics. Although ^T^'jC^'^T^) has the correct 
invariance property, it is a cross-covariance between all pairs of 
symmetry transformed images, whereas a suitable C7' 8+:? ' must be 
an autocovariance of all symmetry transformed images. The 1/s 
normalising factors in 1171 ensure that if g {l) and C (i+i) already 
satisfy statistics invariance conditions < Kit , then resymmetrisation 
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Degrees 


of freedom — 




Degrees 


of freedom- 














permutation symmetry 




permutation and 








Detector coefficients: 




only: 






geometric symmetry: 




n 


N 


linear 


quadratic 


total 


linear 


quadratic 


total 


linear 


quadratic 


total 


1 


1 


1 


1 


2 


1 


1 


2 


1 


1 


2 


2 


4 


4 


16 


20 


4 


10 


14 


1 


3 


4 


3 


9 


9 


81 


90 


9 


45 


54 


3 


11 


14 


4 


16 


16 


256 


272 


16 


136 


152 


3 


24 


27 


5 


25 


25 


625 


650 


25 


325 


350 


6 


55 


61 


6 


36 


36 


1296 


1332 


36 


666 


702 


6 


99 


105 


7 


49 


49 


2401 


2450 


49 


1225 


1274 


10 


181 


191 


8 


64 


64 


4096 


4160 


64 


2080 


2144 


10 


288 


298 


9 


81 


81 


6561 


6642 


81 


3321 


3402 


15 


461 


476 


10 


100 


100 


10000 


10100 


100 


5050 


5150 


15 


675 


690 


12 


144 


144 


20736 


20880 


144 


10440 


10584 


21 


1368 


1389 


14 


196 


196 


38416 


38612 


196 


19306 


19502 


28 


2499 


2527 


16 


256 


256 


65536 


65792 


256 


32896 


33152 


36 


4224 


4260 


18 


324 


324 


104976 


105300 


324 


52650 


52974 


45 


6723 


6768 


20 


400 


400 


160000 


160400 


400 


80200 


80600 


55 


10200 


10255 


25 


625 


625 


390625 


391250 


625 


195625 196250 


91 


24805 


24896 



TABLE II 

(Refer to SectionITvI Square lattice. Reduction in degrees of freedom due to permutation symmetry and geometric symmetry. 
Support linear dimension is n, and number of pixels is N. The numbers of detector coefficients and degrees of freedom are 

resolved into linear and quadratic types. 



by <17> will leave and C^ t+ ^ unchanged. The QFD analysis 
proceeds with symmetrised ensemble statistics gr^ and C^' + ^ in 
place of their unsymmetrised counterparts g' 1 ' and C' I+ -''. 

The QFD is the quadratic filter whose output maximises the ratio 
of the squared difference of means of targets and clutter (dividend), 
to the sum of variances of targets and clutter (divisor). This QFD 
objective function is 



*(/) = 



(/ T g 2 
f T Cf 



which is maximised by the solution to 
Cf = g. 



(18) 



(19) 



In 1 1 8i and I19i g is the difference of means, and C is the sum of 

covariances, for clutter and target ensembles: 



9 

6 



9clu 



ttcr y target ' 



(20) 



Cclutter ~\~ Ctargct • 

Ensemble statistics invariance properties 1 1 61 applied to I19i derive 
detector coefficient invariance properties 

/W =T m f n) t m = lj ... )S t pi) 

under the assumption that C is nonsingular and so <19> has a unique 
solution 12 . For the same reasons that apply to J17I . 



7 (l) — y>i 2 *>/«, 

S ^— ' 

771 — 1 



(22) 



satisfies invariance property 12 1 i for arbitrary f^'. Detector coef- 
ficients invariance 12 1 1 applied to 1 1 21 yields the detector response 
invariance property 



(23) 



which implies that the detector response is the same for all images 
that are point symmetry transformations of each other. Unlike this 

12 C actually has essential singularities due to permutation symmetry, but 
their removal will be addressed soon. 



work, most approaches to filter symmetrisation [1 1]— [16] postulate 
detector response symmetry, from which detector coefficient symme- 
try follows. 

If the argument of objective function a 1 1 8i is restricted to sym- 
metrised detector coefficients / \22\ . then explicit symmetrisation of 
ensemble statistics becomes redundant in the computation of a, that 



v / g 



/ 9 



f Cf 



/ Cf 



(24) 



IV. Degeneracy matrix 

Solving I19i directly yields detector coefficients that are properly 
symmetrised to within numerical accuracy. Then if necessary, ex- 
plicit symmetrisation of the detector coefficients by 1221 will give 
perfectly symmetrised detector coefficients. However, there is a more 
elegant and computationally efficient method of computing perfectly 
symmetrised detector coefficients. This superior method introduces 
a degeneracy 13 matrix to account for permutation and geometric 
symmetry degeneracies. 

As a consequence of the group properties satisfied by matrices 
Tm , matrix 



D 



satisfies the symmetry invariance properties 



D 



(2i)lll 



(2i) n (2»)/// 
m. ' ' 



m = 1, . 



Matrix D (2l)/ " is symmetric, 

jj(2i)lllT jj(2i)lll 



(25) 



(26) 



(27) 



due to the orthogonality property {5J of matrices ri 2 ''. Jj( 2 ^'" has 
nonzero entries everywhere along the main diagonal. If column i\ has 
nonzero entries in rows ii, 12,13,.. . (maximum of s distinct rows), 

13 A set of quantities is said to be degenerate if all of the quantities 
are identically equal, and not simply equal by accident. The concepts of 
degeneracy and symmetry are synonymous. 
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then columns ... are identical. The nonzero entries in a 

given column all have the same value and add to s 14 . 

Matrix D^ 2 *'" has a one entry wherever Z)( 21 )'" has any nonzero 
entry: 



d 



(2»)"CJ.(i). I (9 



(fe w ;/ w ) 



1 if d( 2l »"'(fcW;/W) 
otherwise 



(28) 



where the notation fc'*' is an abbreviation for a 2i-component index. 
Matrix Z)( 2 ''" is symmetric. Because each matrix T„ ' contains only 
a single one entry per row or column, and zeros elsewhere, Z)( 21 '" 
satisfies the symmetry invariance properties 



D (2i)ll _ T (2i) D (2i)n 



m = 1, 



(29) 



Additional to the geometric symmetry being postulated in this 
analysis, it is convenient to impose the permutation symmetry 

f™({ij,kl}) =f (2 \{kl,ij}) (30) 

on the rank 2 tensor detector coefficients. Permutation symmetry 1301 
of /' 2 ' is chosen to correspond to the permutation symmetry of 
|6}. Matrix D^' has a one entry if Z)( 4 '" has a one entry at the same 
row and column, or the same row but permuted column 4-index: 

S 4) '({ij,kl};{i'j',k'l'}) = 

1 if d w "({ij,kl};{i , j',k'l'}) = 1 or 

d^"({ij,kl};{k'l',i'j'}) = l . (31) 

otherwise 



D^' satisfies the geometric symmetry invariance properties 



(4) nW' 



m = 1, 



(32) 



(33) 



and the permutation symmetry invariance properties 

d^'({ij, kiy {i'f, k'i'}) = d^'({ij, kiy {k'i', i'fy = 
d^'dki, ijy {i'f, k'i'}) = d^'({ki, ay {k'i',i'f}) 

Additional to J33I is the property that D^' is a symmetric matrix, 
which may be regarded as another, unavoidable permutation symme- 
try. The redefinition 

D (2), _ D (2)„ ^ (34) 

is adopted for notational consistency. Covariance matrix C and 
its derivatives have multiple essential singularities if permutation 
symmetry is not explicitly taken into account, as is done here by 
replacing D (2l) " by D {2i)l . 

Define the reduced width matrix as having columns that 

are all of the distinct columns of matrix D^' , without repetition. 
Repeated columns in are identified by the property that if 

column ii has one entries in rows ii, 12, is, . . .' 5 , then columns 
ii,*2, J3) ••■ are identical, and there are no other columns that are 
identical to column i\. This property derives from the analogous 
property of D^ 21 '"' that was noted earlier in this section. Matrices 
Z)( 2 ' and D' 4 ' respectively are the rank 2 and rank 4 tensor 16 parts 
of degeneracy matrix D: 



flW 



D EE 



(35) 



14 A square lattice has s = 8, and columns of £)( 2 ^'" may have 8 Is, or 4 
2s, or 2 4s, or 1 8 entry, although only _D( 4 )'" actually has columns with 2 
4 entries. 

15 Maximum of s distinct rows for Z)( 2 ''; maximum of 2s distinct rows for 
flW. 

16 Since the column index of D'' 2 ^ can not be expressed in terms of 2- 
indices, Z)( 21 ) are strictly not tensors in the context of this analysis. But 
matrices Z)( 2! ) are derived from rank 2i tensors, hence the terminology. 




Centre of hexagonal r- Wigner-Seitz 

(12-fold) symmetry \ primitive cell 

(2n-l,n) (n,n) 
#\ • • • • • 

• • * \ ,• — • — ^ V • 

(3,2) (2,2) \ 
• • f * \* * 

(3n-2,n) / 

• • • (4,2)* x ,*<'- 2 > * yv<$ • • • 

\ (i,i) / 

• * \ * — 4 

\ \ (5,2) (6,2) / / (6n-6,n) { A S 

• • ^ W~ p • • ■ ) > • 

(4n-3,n) (5n-4,n) 

• ••••• •• 

^Lattice constant ^-C 

(6-fold) symmetry 

Fig. 2. (Refer to Section |VJ A section of hexagonal lattice. Nonequivalent 
points marked X correspond to different symmetries — lattice points have 
hexagonal symmetry, and interstitial sites have triangular symmetry. Shown 
is a detector support of linear dimension n, and the pixel indexing scheme. 



D' 21 ' satisfies the geometric symmetry invariance properties 

D (2i) = T gi) D (2i) ^ m = X) . . . , s , (36) 

and the permutation symmetry invariance properties 

d (4 \{ij,kl};m) = d w ({kl,ij};m) . (37) 

Let / be an unconstrained nondegenerate detector coefficient 
vector. Then 

7 = Df (38) 

is a degenerate coefficient vector that has both the required geometric 
symmetry <2U and permutation symmetry <30t . Each row of matrix 
D has a single one entry and zeros elsewhere. Multiple one entries in 
a column of D associate degenerate coefficients in the symmetrised 
detector /. The number of columns in D, and the number of com- 
ponents in /, is the number of degrees of freedom 17 of the detector. 
Substituting 1381 into 1241 re-expresses the objective function as 



*(/) 



/ Cf 



where the nondegenerate mean vector g is 

~ _ n T~ ,-.T 

9 = D g = D g , 
and the nondegenerate covariance matrix C is 



(39) 



(40) 



(41) 



The second equalities in 1401 and 14 II . which also may be derived 
from I17i and J36I . affirm the redundancy of statistics symmetrisation 
already noted in association with 1241 . Equation <4U shows that the 
degeneracy matrix formalism maximally compresses the covariance 

17 Degrees of freedom of the detector are the independent coefficients 
remaining after accounting for all symmetries and before maximising the 
objective function. 
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Symmetry: 


Description of symmetry 
operation 


Factorisation 


Rank 2 tensor representation: 

m uvJi 1 J J / 


T x 


Identity or unit operation. 


T 2 


8(i,i'). 

"(3,3 I 


T 2 


Anticlockwise rotation by 
i/o turn. 


T 2 


8(i, («' + j' - 2) mod 6(j' - 1) + 1). 
"(3,3 ) 


T 3 


Anticlockwise rotation by 
1/3 turn. 


T 2 


8(i, («' + 2j' - 3) mod 6(j' - 1) + 1). 
"(3,3 ) 


T4. 


Rotation by 1/2 turn, being 
inversion through centre. 


rp 3 

1 2 


8(i, («' + 3j' - 4) mod 6(j' - 1) + 1). 
"(3,3 ) 


T 5 


Clockwise rotation by 1/3 
turn. 


rp 4 

1 2 


8(i, (i' + Aj' - 5) mod 6(j' - 1) + 1). 
"(3,3 I 




Clockwise rotation by 1/6 
turn. 


rp 5 

1 2 


8(i, (i' + 5j' - 6) mod 6(j' - 1) + 1). 

°\h3 ) 


T 7 


Reflection in the x-axis. 


T 7 


8(i, - i' - 5) mod 6(j' - 1) + 1). 

°\h3 ) 


T 8 


Reflection in line 1/12 turn 
anticlockwise from x-axis. 


T 2 T 7 


8(i, (7j' - i' - 6) mod 6(j' - 1) + 1). 
o\h3 ) 


T 9 


Reflection in line 1/6 turn 
anticlockwise from x-axis. 


T 2 T 7 


S(i, (8f -i' - 7) mod 6(j' - 1) + 1). 
o(j,3 ) 


T W 


Reflection in the y-axis. 


TrfT 7 


8(i, (9f - i' - 8) mod 6(j' - 1) + 1). 
x3,3 ) 


T n 


Reflection in line 1/6 turn 
clockwise from x-axis. 


T 2 4 T 7 


8(i, (10f - i' - 9) mod 6(j' - 1) + 1). 
6(3, j') 


T 12 


Reflection in line 1/12 turn 
clockwise from x-axis. 


T 2 5 T 7 


8(i, (llj' - i' - 10) mod 6(j' - 1) + 1). 
5(j, j') 



TABLE III 

(Refer to Section[V} Hexagonal lattice point group symmetry operations and their rank 2 tensor representation; the rank 4 
tensor representation is derived from the rank 2 tensor representation according to llol . orientation of the lattice is such that 
a basis vector aligns with the x axis, as in flgure[2] note that the modulo operation is always with respect to - 1). 



matrix without loss of information; an alternative approach due to 
Lenz [17], [18] partially compresses the covariance matrix into an 
equal size block diagonal matrix, whose top-left block has precisely 
the same size as C of I41i . 

Maximisation of objective function I39i is equivalent to solving 
(cf. {19}) 

Cf = g , (42) 

whose solution is 

J = C ] g , (43) 

where is the Moore-Penrose generalised inverse (or pseudoin- 
verse) [19] of C. A property of solutions of the form 1431 obtained 
by generalised inversion is that they are the minimum norm vector 
that minimises the Euclidean norm of the residual (Cf — g) [20], The 
residual vanishes if C is nonsingular, in which case the generalised 
inverse is equivalent to the conventional inverse. QFD generalisation 18 
may be improved by regularising C [21], [22] before solving I42i . 

A necessary and sufficient condition for C to be nonsingular is 
that the clutter and target training ensembles between them must 
contain no fewer linearly independent images than the number of 
symmetrised detector degrees of freedom. In contrast, symmetrised 
covariance matrix C (and unsymmetrised covariance matrix C) 
contains many essential singularities, no matter how large the training 
ensembles. Zero eigenvalues of C are at least equal in number to 
the number of permutation symmetry degeneracies in the detector 

^Generalisation of a detector refers to the consistency of detector perfor- 
mance when assessed separately against training and test ensembles. 



coefficients; beyond that there may be extra zero eigenvalues due 
to small training ensemble sizes. The present degeneracy matrix 
removes the essential singularities in C or C by operation <4H . 

Table [2] shows the reduction in degrees of freedom afforded 
by permutation and geometric symmetries. Permutation symmetry 
among the N + N 2 coefficients leaves + A^iV^ l)/2 degrees of 
freedom. This is a reduction in degrees of freedom by a factor of up to 
2. Maximum reduction is achieved for large detector supports, where 
the proportion of quadratic terms that are pixel self-products becomes 
small. Geometric symmetry further reduces the degrees of freedom 
by a factor of up to s (s = 8 for a square lattice, to which Table Q3 
applies). Maximum reduction occurs for large detector supports, 
where proportionately few pixels and pixel pairs map onto either 
themselves under symmetry transformations, or common pixels or 
pixel pairs under different symmetry transformations. The reduction 
in degrees of freedom attributable to geometric symmetry should 
constitute a significant improvement in detector generalisation, when 
the unsymmetrised detector" generalises poorly. 



V. Hexagonal lattice symmetry 

The most symmetric possible plane lattice has a 6-fold rotation axis 
through a lattice point, around which are 6 mirror lines in the lattice 
plane uniformly spaced by angle 7r/6; this lattice is the hexagonal 

"That is, a detector that accounts for permutation symmetry, but not 
geometric symmetry. 
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Degrees 


of freedom- 




Degrees 


of freedom- 














permutation symmetry 


permutation and 








Detector coefficients: 




only: 






geometric symmetry: 




n 


N 


linear 


quadratic 


total 


linear 


quadratic 


total 


linear 


quadratic 


total 


1 


1 


1 


1 


2 


1 


1 


2 


1 


1 


2 


2 


7 


7 


49 


56 


7 


28 


35 


2 


6 


8 


3 


19 


19 


361 


380 


19 


190 


209 


4 


26 


30 


4 


37 


37 


1369 


1406 


37 


703 


740 


6 


77 


83 


5 


61 


61 


3721 


3782 


61 


1891 


1952 


9 


189 


198 


6 


91 


91 


8281 


8372 


91 


4186 


4277 


12 


394 


406 


7 


127 


127 


16129 


16256 


127 


8128 


8255 


16 


742 


758 


8 


169 


169 


28561 


28730 


169 


14365 


14534 


20 


1281 


1301 


9 


217 


217 


47089 


47306 


217 


23653 


23870 


25 


2081 


2106 


10 


271 


271 


73441 


73712 


271 


36856 


37127 


30 


3206 


3236 


11 


331 


331 


109561 


109892 


331 


54946 


55277 


36 


4746 


4782 


12 


397 


397 


157609 


158006 


397 


79003 


79400 


42 


6781 


6823 


13 


469 


469 


219961 


220430 


469 


110215 


110684 


49 


9421 


9470 


14 


547 


547 


299209 


299756 


547 


149878 


150425 


56 


12762 


12818 


15 


631 


631 


398161 


398792 


631 


199396 


200027 


64 


16934 


16998 



TABLE IV 

(Refer to SectionIvI Hexagonal lattice. Reduction in degrees of freedom due to permutation symmetry and geometric symmetry. 
Support linear dimension is n, and number of pixels is N. The numbers of detector coefficients and degrees of freedom are 

resolved into linear and quadratic types. 



lattice 20 . As shown in Figure [2] the hexagonal lattice is generated by 
two equal length basis vectors subtending angle n/3. With centre of 
symmetry at a lattice point, hexagonal lattice point symmetry is of 
order 

s = 12 (hexagonal lattice) . (44) 

Unlike the square lattice, interstitual sites in the hexagonal lattice 
have reduced symmetry compared with lattice point centres. The 
6-fold point symmetry of hexagonal lattice interstices 21 is even 
lower than the 8-fold point symmetry of square lattices. Clearly, 
one would not sample on an hexagonal lattice, only to use detector 
supports centred on interstices. Having established that the detector 
support will be centred only on lattice points, Figure [2] shows a 
regular hexagonal support of linear dimension n, and a suitable pixel 
indexing scheme. The support linear dimension n is the number of 
concentric hexagons that account for all pixels, where the central 
lattice point counts as a hexagon of vanishing size; equivalently, the 
linear dimension is the number of lattice points between adjacent 
vertices of the support perimeter. A spiral indexing scheme is adopted 
for the hexagonal lattice, where (i, j) represents the ith lattice point 
in the jth concentric hexagon. An analogous spiral indexing scheme 
could have been used for the square lattice, the result being a closer 
correspondence between the point symmetry tensor representations 
for square and hexagonal lattices than is evident in comparing Tables 
Q and Mill The row-column indexing scheme actually used for the 
square lattice in TableQis conventional, and allows simpler expression 
of tensor representations, as is evident in comparing Tables HI and ITIT1 
The square lattice analysis of Section UJ also holds for the hexag- 
onal lattice, with the following detail amendments. The total number 
of pixels in the hexagonal support is (c.f. Q) 

N = 1 + 3n(n - 1) . (45) 

20 The hexagonal lattice is often called the triangular lattice, since interstices 
have three lattice points at the vertices of equilateral triangles as nearest 
neighbours, much as square lattice interstices have four lattice points at the 
vertices of squares as nearest neighbours. The alternative convention used 
here is that lattices are named according to their point symmetry and their 
Wigner-Seitz primitive cell. 

2 'Unlike square lattices, hexagonal lattice interstices are of two nonequiv- 
alent types, depending on whether they are centred on upright or inverted 
triangles of nearest neighbour lattice points. 



Clutter: 



Targets: 

U U ■ B fcl □ 

Fig. 3. (Refer to Section IvTi Sample clutter and target 9x9 image chips as 
used in the experiment. 

Radial index j and circumferential index i transform to 2-component 
index {ij} according to (c.f.[4j 

{»i}=i + min(l,j-l) + 3(7-2)(7-l) : r4fi , 
j G [l,n] , i G [l,max(6(j - 1), 1)] , {ij} € [1,7V] . K ' 

Details of the hexagonal lattice point group — being the dihedral group 
D% — are presented in Table llllf 2 (c.f. TableQ. Point subgroups of the 
hexagonal lattice are: {Ti, T2, T3, T4, T5, T§} representing a 6-fold 
rotation axis; {Ti , T 3 , T 5) T T , T 9 , T u } and {Ti , T 3 , T 5 , T 8 , Tin , T 12 } 
representing 6-fold triangular symmetry; {Ti,T3,Ts} representing 
a 3-fold rotation axis; {Ti,T 7 }, {Ti,T 8 }, {Ti,T 9 }, {Ti,T 10 }, 
{Ti,Tti} and {Ti,Tja} representing 2-fold reflection symmetry 
(one mirror line); and {Ti} representing complete absence of ge- 
ometric symmetry. Depending on the degree of symmetry of the 
continuous image ensembles, it may or may not be beneficial to use 
hexagonal sampling instead of square sampling. For an hexagonal 
lattice, T^ 2 *' has eigenvalue 1, T4 *' and T 7 _j 2 have eigenvalues 1 
and -1, T 3 (2i) and T 5 (2i) have eigenvalues 1 and -1/2 ± V5/2i, and 
T 2 (2i) and T b < 2i) have eigenvalues ±1, 1/2 ± VE/2i, and -1/2 ± 
\/3/2i. The only amendment to the degeneracy matrix analysis of 
Section ITvl is that for the hexagonal lattice columns of J)' 2 '"' have 
either 12 Is, or 6 2s, or 1 12 entry; likewise for Z)( 4 )"' with the 

22 Derivation of the rank 2 tensor representation of the hexagonal lattice 
point group requires the following identity: (i + j mod n) mod n = (i + 
j) mod n, for n = 0, 1, 2, . . ., where the definition ■ mod = is 
adopted. 
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Unsymmetrised QFD DET curves Symmetrised QFD DET curves 

10° , i 10 t — 




False-alarm probability False-alarm probability 



Training ensemble DET curves „ Test ensemble DET curves 

10 ° , , , , 10° f , , — 




False-alarm probability False-alarm probability 



Fig. 4. (Refer to Section IvTi Training and test ensemble DET curves of the unsymmetrised and symmetrised QFDs, plotted in various combinations to aid 
comparison. Dual axis error bars are shown in graphs (a) and (b). 



inclusion of columns with 3 4 entries. Columns with 4 3s or 2 6s, 
although plausible on number theoretical grounds, never occur in 
D (2i)/ " (c.f. Footnote fl4l. 

Reduction in detector degrees of freedom consequent on hexag- 
onal lattice permutation and geometric symmetries is quantified in 
Table IIVI (c.f. Table [i]}. Support linear dimensions are quantified 
by n for both square and hexagonal lattices, but n is akin to the 
support diameter for the square lattice and radius for the hexagonal 
lattice. Accordingly, square and hexagonal supports with the same 
n contain very different numbers of pixels — almost 3 times more 
in the hexagonal support for large n. A hexagonal support of linear 
dimension n is closer in pixel population to a square support of linear 
dimension 2n — just over 1/3 more in the square support for large 
n. Permutation symmetry reduces degrees of freedom by a factor of 



almost 2 for larger supports, for both square and hexagonal lattices 23 . 
Geometric symmetry reduces degrees of freedom by a factor of 
almost s for large supports, for both square and hexagonal lattices. 
The hexagonal lattice, with s = 12, achieves greater reduction in 
degrees of freedom than the square lattice, with s = 8. 

VI. Experimental results 

The effect of QFD symmetrisation on target detection in real 
imagery is investigated. Discrimination is between SAR images of 
bushland and SAR images of a variety of vehicles immersed in the 

23 The reduction in degrees of freedom due to permutation symmetry is 
independent of sampling lattice, but depends on the degree of the detector's 
polynomial response function. For an mth degree polynomial detector, per- 
mutation symmetry reduces degrees of freedom by a factor of almost m! for 
large supports. 
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same bushland, samples of which are shown in Figure [3] Images 
are sampled on a square lattice. Image ensembles are a mixture 
of different flights of a spotlight SAR illuminating the ground at 
different angles of incidence. Clutter images are not just random 
samples of the background, but are background regions that 'tricked' 
a simple prescreener into declaring a target; hence the difficulty of 
distinguishing between clutter and targets in Figure [3] In these ex- 
periments ensemble sizes are: clutter training — 17197 ; clutter test — 
37909 ; target training — 3425 ; target test — 3579. Detector support 
is 9 x 9 pixels, so n — 9. Unsymmetrised and symmetrised QFDs 
are computed by the same procedure, but using different degeneracy 
matrices D. The unsymmetrised detector degeneracy matrix accounts 
for only permutation symmetry, while the symmetrised detector 
degeneracy matrix accounts for the full 8-fold square lattice point 
symmetry as well as permutation symmetry. It has been noted in 
Section Q3 that square lattice sampled SAR image ensembles strictly 
have only 2-fold symmetry, so in principle the detector is being ex- 
cessively symmetrised here. Justification for maximally symmetrising 
the detector is that SAR image ensembles have approximately 8- 
fold symmetry, and that imposing the full 8-fold symmetrisation on 
the detector allows verification of the full square lattice point group 
representation tabulated in Table However, there is a risk that 
the excessive symmetrisation will reduce the detector effectiveness 
compared with its unsymmetrised counterpart. 

Experimental 'detection error trade-off (DET) 24 curves are plotted 
in Figure |4] in various combinations to assist comparison. Error bars 
(±1 standard deviation) are plotted in graphs that compare training 
and test ensemble DET curves (i.e. graphs (a) and (b)). Graph (a) 
demonstrates that the unsymmetrised QFD generalises poorly, while 
graph (b) demonstrates that the symmetrised QFD generalises well. 
The reason for this behaviour is revealed in Table QI] which states 
that the unsymmetrised QFD has 3402 degrees of freedom compared 
with the 476 of the symmetrised QFD. There is more scope for the 
unsymmetrised QFD to overtrain on the training ensemble than there 
is for the symmetrised QFD, as is apparent in graph (c). That the 
unsymmetrised QFD is going to generalise poorly in this example, is 
predictable beforehand on the basis of the number of detector degrees 
of freedom (3402) not being much less than the size of the smaller of 
the target and clutter training ensembles (3425). Both unsymmetrised 
and symmetrised detectors should have their generalisation improved 
by regularisation procedures [21], [22]. Graph (d) demonstrates that — 
despite the caution expressed at the end of the previous paragraph — 
the symmetrised QFD is more effective than the unsymmetrised 
QFD when tested on the test ensembles, and the advantage is most 
pronounced at the important low false-alarm probabilty extreme of the 
DET. The correctness of the square lattice point group representation 
tabulated in Table has been verified, and the practical value of 
QFD symmetrisation — even theoretically excessive symmetrisation — 
has been established. 
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